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Abstract 

1 I In most natural sciences there is currently the insight that it is necessary 

to bridge gaps between different processes which can be observed on different 
scales. This is especially true in the field of chemical reactions where the abili- 
ties to form bonds between different types of atoms and molecules create much 
O of the properties we experience in our everyday life, especially in all biological 

activity. There are essentially two types of processes related to biochemical re- 
action networks, the interactions among molecules and interactions involving 
their conformational changes, so in a sense, their internal state. The first type 
of processes can be conveniently approximated by the so-called mass-action 
^ kinetics, but this is not necessarily so for the second kind where molecular 

^ states do not define any kind of density or concentration. In this paper we 

demonstrate the necessity to study reaction networks in a stochastic formula- 
tion for which we can construct a coherent approximation in terms of specific 
space-time scales and the number of particles. The continuum limit procedure 
naturally creates equations of Fokker-Planck type where the evolution of the 
concentration occurs on a slower time scale when compared to the evolution 
of the conformational changes, for example triggered by binding or unbind- 
ing events with other (typically smaller) molecules. We apply the asymptotic 
theory to derive the effective, i.e. macroscopic dynamics of the biochemical 
IL/ reaction system. The theory can also be applied to other processes where en- 

. 5^ tities can be described by finitely many internal states, with changes of states 

occuring by arrival of other entities described by a birth-death process. 

1 Introduction 



Systems formed by a large mimber of biochemical reactions are often considered 
paramount examples of complex systems. Such systems are formed by a set of 
interactions among various species of molecules forming new, larger species. More- 
over there are interactions involving conformational changes coinciding with bind- 
ing/unbinding events of typically smaller molecules. It is important to note that 
the description of interactions depends on the choice of the scales at which the en- 
tire system is analysed. The microscopic description of a reaction system is usually 
fairly well understood in its general features. At atomic scale the necessary theory 
is provided by Quantum Mechanics, at molecular level there are different types of 
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kinetic theories. After a heuristic up-scaHng most reaction systems can be suffi- 
ciently well described by mass-action kinetics, which is a mean-field approximation 
of the fully stochastic description |7] , [2] . 

We now consider systems at scales to be considered mesoscopic. These are pre- 
cisely the scales of any kinetic theory. Let us denote with 6 a vector describing the 
selected space scale and the number of particles in the system, whereas r denotes 
the system time scale. With fixed S, t we can typically look at reactions specified 
by the reaction rates k{S,T), where we incorporated scale dependence. Given these 
reaction rates it is possible to construct the associated dynamics in terms of the 
master equation (ME), which is the appropriate probabilistic description of the dy- 
namics precisely at the given scales S, r. If the system contains both interactions 
among particles and interactions involving conformational changes possibly with 
additional binding/unbinding events of smaller molecules, then the ME turns out 
to be a combination of two types of operators: one describing birth-death processes 
with infinite possible states, and the other one governing the evolution in the finite 
state space. This finite state space (denoted by S) describes conformational changes 
and mutual binding/unbinding of molecules. 

The process of removing the scales (5^0 and r — )■ 0) under the condition 
to keep finite reaction rates k(S,T) is called continuum limit. This process pro- 
duces a Fokker-Planck equation (FPE) that describes the effective time evolution 
of the probability distribution of the state of the system. The continuum limit is 
dependent on fixing a relation among d, r. A better known and typical case is the 
derivation of a diffusion equation, where l^^/r = D > is kept finite. We shall 
show that the choices involved in the continuum limit determine a FPE where the 
time scale of the evolution of molecular concentrations is larger, i.e. longer than 
the time scale at which the evolution in finite state space E takes place. The for- 
mulation of the continuum limit will be done following the Trotter approximation 
method, see [T3], or ^U\. We shall illustrate how the limit for S ^ and t ^ leads 
naturally to the use of asymptotic analysis and an adiabatic theory to study the 
FPE. Previous applications of these ideas to study chemical reaction networks can 
be found in [3] and [1]. The multi-scale analysis for such systems has been studied 
extensively, see for example fS] and (9]. In this paper we present the asymptotic 
solution of the FPE motivated by the continuum limit. We give a general formu- 
lation of the approach where the stochastic processes involved are not necessarily 
Markovian. Nevertheless our main results will deal only with reaction systems in- 
volving elementary processes which are Markovian. In this setting the particles will 
undergo diffusion and the finite states will evolve according to a Markov chain logic. 

A set of reactions can naturally be described as a network and more precisely 
as a graph. Indeed in this paper we show that graph-theoretic notions can be used 
at the very beginning of modelling as a tool to understand the possible processes. 
The associated graph is generally called the Interaction Graph (IG), its vertices 
are the possible states and its edges correspond to the interactions leading to state 
switches. The IG is then modified throughout the analysis, in fact the continuum 
limit produces variations in the vertices and in the edges. In particular it turns 
out that the leading order term of the asymptotic expansion is a deterministic dy- 
namics termed average dynamics. The average dynamics is determined by a vector 
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field resulting from the average of a finite family of vector fields {X^°'^}cr£j: taken 
against the invariant measure of the finite Markov chain (MC) on S. The IG as- 
sociated to the average vector field will result as a combination - resembling an 
average - of the IGs associated to vector fields describing each single finite state. 
The construction of the average dynamics and its IG can be seen as a first step to 
connect the stochastic description to the classical differential equations approach. 
To explore the possible applications of graph theory to reaction systems given in 
terms of differential equations the reader could look at the review [4 .This paper 
deals with different graph theoretic methods giving information on the qualitative 
behaviour of the reaction system once it has been established on the mesoscopic or 
macroscopic scale. 

The continuum limit and the asymptotic analysis will be illustrated by three 
simple examples: a particle with two internal states diffusing on a line, and two 
possible schemes for a molecular switch. In these systems we show how to identify 
the scaling regimes which characterise the dynamics and the adiabatic expansion for 
the associated Fokker-Planck equations. We also show how the network structure of 
the reactions affects the expansion, in particular with respect to the leading order 
term, i.e. the average vector field and the appearance of noise. 

2 General formulation 

Let us consider species jii,...,nN of particles each of which can take any value 
in a dimensional lattice L and a variable a which can assume values in a fine set 
E with |E| = M. At any time t the system has its configuration determined by 

(n,CT) e L X S. 

Remark 1. Note that we did not include explicitly the space variable. This can 
be easily done by a suitable enlargement of the lattice L. 

The time evolution of the system is stochastic and therefore the main object of 
interest is the probability measure 

P(n, (T, t), normalised by -P(n, (j,t) — 1. 

ReL cres 

Dynamical processes 

The time evolution of P{n, a, t) is determined by certain processes which affect the 
state of the system. It is their nature and characteristics which prescribe the form 
of the dynamical equations. The dynamical processes are strongly related to the 
scale at which the system is considered. Let us fix + 1 scales, i.e. 

• T, the time scale, 

• a vector S = {6i, Sn), the natural length scales of the generators of L. 

The possible processes we shall consider have a general diffusive behaviour, that 
is each process is characterised by having a specific waiting time probability distribu- 
tion, generically denoted by ipit)- It is important to note that many application will 
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require that is not necessarily exponential, for example in processes generating 
sub-diffusive behaviour. With fixed 4^(t) and a given process we know that the 
dynamical transition produced by that process will take place in the time interval 
[ti,i2] with a probability given by 

The knowledge of the waiting time distribution is in general related to the under- 
standing of the processes and their relevant interactions at the scale identified by r 
and S, therefore it is expected that the functions ^ are dependent on such scales. 
Upon these observations we can now set up the microscopic reaction schemes linked 
to the processes. These are classified according to the following list: 

(PI) (ni, Tii, Tijv, cr) {ni, ...,ni ± 6i, ...,nN,<y), with waiting time distribu- 
tion 'ip„.(t;di,T); 

(P2) (ni, ...,nN,(y) ^ ?^Ar, tr'), with waiting time distribution ipai^', t); 

(P3) (ni, rii, njv, c) ^ (ni, ± (5^, njv, cr'), with waiting time distribu- 
tion Ipa^nS^; Si,T). 

Here (PI) describes the appearance or annihilation of particles, without changes 
of any of the internal states as described by a, (P2) describes a transition of the 
internal states from a to a' while fixing the number of particles in the system, and 
(P3) describes the simultaneous transition of internal states linked with the ap- 
pearance or disappearance of a particle of a certain type. Here we must distinguish 
two cases for the interpretation of L. If we model a spatially averaged system we 
only consider L as representing the species number, so appearance or disappearance 
models whether particles enter or leave the system. If L includes spatial positions 
then appearance or disappearance is interpreted with respect to any local position. 
See also Figure [2] 

General Master Equation 

Each process can in principle occur with a specific waiting time governed by its 
own distribution function. This implies that the evolution is described through a 
general master equation (GME) (see [3 ). The discrete form of this equation is 

P{n,a,t + T) = I At' C„„>[nJ,T,t-t']P{ri,(j\t')+ 
+ Y. I At'IC,[nJ,T,t^t']P{n,a',t'), 

where 
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(1) 



• £ is a, M X M matrix whose entries depend on n, S, t and on the waiting time 
distributions defined in (PI) and (P3). In particular it will be useful to write 
C by means of the operators defined by 

Ef /(ni, ...,nN) .f{ni, ...,ni ± 6i, ...,nAr) for any / : L ^ M. 

• /C is a A/ X M matrix whose entries depend on n, S, t and on waiting time 
distributions defined in (P2). 

Remark 2. The structure of the GME is essentially the one introduced in |3] and 
[13] to describe the continuous time random walk (CTRW) . It is worth noting that a 
standard random walk (RW) can always be considered as a special case of a CTRW. 

Note that the normalisation condition for the probability requires 

f dt' {c,[nJ,T,t-t']+IC,[nJ,T,t-t']}p{n,cT',t)^l 
for any P{n, a, t). 

A graph for the General Master Equation 

The structure of equation (jlj allows a useful interpretation in terms of associated 
graphs. 

Definition 1. We denote by T{£, JC) the graph whose vertex set is = L x E and 
edge set E{C,IC), where the directed link (arrow) g..) ^ ) is present if both 
C and /C allow the transition (ni,ai) i— *■ (nij, tTj). In general this graph will have 
loops. 

An illustration of this graph can be seen in Figure [l] 

If one wants to include that the configuration space is the product L x E, then the 
graph can be thought to be as in Figure [2] 

2.1 Formulation of the double limit r ^ 0, 5 ^ 

We are interested in the GME that results by taking the limits 

T — > and (5i — > for all i. 
First we expand P(n, cr,t + t) up to the first order in t. This can be written as 



dP{n, cr, t) 



T = -P(h, <J,t)+Y, I di' CI,, [n, lT,t- t'] P(n, a', t'y 



dt 

(2) 



^ / dt'IC^,,[n,lT,t-t']P{n,a\t')+o{T) 

JO 



cr'eT: 

or equivalently 
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Figure 1: A small portion of a general graph 1{£,JC) 




CTi ►CTj 



n-^ n n + 6 

Figure 2: A simple description of the the product L x E and the graph links. Dif- 
ferent types of state transitions result in vertical, horizontal or diagonal movements 
in the finite and infinite state sets. 
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dP{n,cr,t) _ 1 f* 
dt ^ r 



/ dt' {CI, [n, I T,t-t']-S{t- t'))P{n, a, t') 
Jo 

+ - J2 / dt'£;,,[n,lT,t-t']P{n,a',t') (3) 
+ - E / dt'/CL,[n,^,T,t-t']P(n,a',0 + o(r). 
To proceed further it is necessary to study the following three limits: 

lim - f dt'iC*,,[n,lT,t-t']-Sit-t'))Pin,a,t'), (4) 

lim f dt' ClA^,lT,t-t']P{n,a',t'), 



(5) 



a' 

ct 



lim - V / dt'/C^^,[n,(5,T,t-t']P(n,(T',i')- (6) 

2.2 Multiscale analysis: simplified assumptions 

The study of the limits Q, (|5| and ([6]) in this general form is very difficult. In 
order to proceed and to analyse equation ([l]) some simplifying assumptions are in 
order. We shall consider two main sets of such assumptions which identify two 
classes of systems that are called Infinite MC coupled with finite MC and Infinite 
MC coupled with finite CTRW, respectively. We introduce them in this order and 
simultaneously discuss the continuum limit procedure. 

Infinite MC coupled with finite MC 

The first set of assumptions is: 

(Al) On L, we have Si — 6 for all i. 

(A2) Each waiting time is exponentially distributed. 

(A3) Each is the adjoint of a generator of a Markov process valued in L. 
(A4) For fixed n, S, the transpose of the kernel K,^ generates a Markov chain on S. 
Under these conditions we have 

CI,, [n, S, T, t^t']^ CI,, [n, 5] 5{t - t') and IC^,, [n, I r, t-t']= JC^,, [n, S] 6it - t'). 

Here 5{.) denotes the Dirac delta distribution. The limits Q, (|5]), ([6]) reduce re- 
spectively to 

liin -(/;:,[n,5]-l)P(n,a,i), (7) 

r— >0,5— >0 T 
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n" E ^-'["''^]^("''^''^)' 

a' 

, - E^-'["''5]^(n'^':*)- (9) 

We can give a meaning to these limits by assuming that the two scales r and (5 go 
to zero in a prescribed manner. A typical interesting regime is the diffusive one, 
namely when ~ _D > 0, with D being the diffusion coefficient. Note that the 
limit process transforms the lattices L into into a limit state space given by 

X S. 

The continuum limit is based on the approximation method developed by Trotter 
in [T3], later also worked into [TD], [5]. We shall now outline this approach. The 
ME is in general constructed as an operator acting on probability measures. One 
has to observe that the natural setting to construct the continuum limit is the 
space of functions, rather than the space of measures. We have seen that the ME 
is constructed by fixing the space-time scales (5 and r. Let us introduce an index 
to enumerate the scales: t„. The nth scale corresponds to the lattice L„. We 
denote the result by X„ = ^°°(L„,K*^), with norm 



||0||„= sup |0(k)|, 

where (?!)(k) = </)(fci, /cjv) is an element in the set X„. Each X„ is a Banach 
space and can be see as an "approximation" of X = C°(M^,M^^). In fact we can 
define the projection 

"PniXl-^Xn, 

In particular, for any / G C°(M^,M*0, we have P„(/)(k) = /(k(5„) = /(fci<5„, fcAr(5„). 
The following properties hold: 

(i) linjin < 1, 

(ii) lim„^oo \\VM\n = ll/llo for all / G C"(M^,M^O. 

See [TD] for more details. Using [T3], we state a condition defining whether a se- 
quence of functions in the collection {X„}„ of functions in X„ approximate a func- 
tion in X: 

Definition 2. Let /„ G X„. The sequence (/„) converges to / G X if and only if 



lim WVnif)- fn\\n=0. 

n — ^oo 

This convergence is denoted here by /„ ~ /. 
This allows us to define the continuum limit: 
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Definition 3 (Continuum limit of operators). Let £„ : X„ i-^ X„. The sequence 
(£„) of linear operators has a continuum limit £ : X i-^ X if an only if there exist a 
choice of Sn and r„ such that (5„ — > 0, r„ ^ and 

lim \\CMf) ~ rnC{f)\\n = 0, for all / £ X. (11) 

n — >QO 

As before this limit is denoted by £„ « £. The domain of £ is formed by all 
/ £ X such that the sequence Cn'Pnif) S converges. 

Remark 3. It is worth emphasising that the continuum limit of an operator is not 
unique. In fact relation between 5„ and t„ is crucial in definition [s] We shall see 
in the examples that the scaling relations among the parameters in £„ identify the 
possible continuum limits. 

For every fixed n the dual of X„ is the space X* , formed by the measures P such 
that 

{PA)n - ^0(k)(.)P(k) = (E'^'(k)P,(k) ) (12) 



is finite. The ME is defined on the dual space X*. Using the pairing (12 1 one 
can transfer the ME to be defined on X„ by using 

(/:;P»„ = {P,Cn^)n and (/C^P,<^)„ - (P„,/C0)„. 
On the Banach space X the standard duality is given by 

(pj)^ [ dx/(x)(.)p(x) = / dxE/,(x)p,(x). (13) 

JR" JR" ~[ 

Given the continuum limits C and K. we can therefore define their adjoints 

{p,Cf) = {tpj) and (p,/C/) - {IC^pJ). 
We now give some basic examples. First let us state 

Definition 4. Let L = 5 N, and let </> be : L ^ E. Then the couple of operators 
A* acts on X„: 

A±(0(fc)) = (E± - id)((/)(fc)) - cf>{k ± Sr.) - cb{k). 
One can easily show that (A+)* — — A^, namely 

(A+P,0)„ = -(P, A"(/))„, for every n. 

Also clearly the operator A+ + A~ is symmetric. We compute the continuum 
limit of = (l/r„)A+ and take a sequence P„/ with / e X. The aim is to 
compute 

£+P„(/)(fc) = - {f{kSn + Sr.) - fikSn)). 

This can be rewritten as 
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C+V^Um - Vr. ( - {f{x + 6„) - fix)) 

For n large enough, 5n,T„ are arbitrary small. Taking / in a suitable dense 
subspace of X we can write 

<5„ df , 61 , 1 ,,2, 



' r„ da; r„ dx^ / r„ 



Now (111 can be verified by taking the limit. We have that 



- d 

£+ = C — for 6n/Tn ^ c> 0. 

ox 

Once the continuu m l imit of C is constructed on X we can take the adjoint 



operator with respect (13 1. Then, for example, (£+)* — (cd/dx)* — ~c{d/dx). In 
this sense we assume that the limits ([7|, ^ and ([9| are 

^(C,[n,5] -l)P(n,a,i) «C,[x]p,(x,t), (14) 



^ ^ 0[fi,'5]P(n,a',i) « ^ 0[x]p.'(^,i), (15) 

\ J2 C'[fi,'5]P(n,a',t) « ^ £j,[x]p,,(x,i), (16) 

where £* is a matrix with entries differential operators and /C"^ is the transpose 
of the infinitesimal generator of a finite Markov chain on S. An interesting further 
simplification is obtained if processes of type (P3) do not occur. This implies that 

(i) ^ for a ^ a', 

(ii) arc Fokkcr-Planck operators. 

In this case we have that the degrees of freedom are represented by x diffuse 
in M^, while the discrete states cr's evolve in E according to a finite Markov chain 
generated by K.. 

We now look at a second set of assumptions: 

Infinite MC coupled with CTRW 

The second set of assumptions is 

(Al) On h, 6,^5 for all i. 

(B2) The waiting times 'ipa-,niit] ^i) are exponentially distributed, independent of 
6 and r. 

(B3) Each C^a' is a generator of a Markov process valued in L. 
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(B4) For fixed n, S the kernel K, generates a continuous-time random walk (CTRW) 
on S. 

Under these conditions we have 



C„„'[n,d,T,t - t'] ^ £„„,[n,6]6{t - t') and /C^^-' [n, <5, r, t - i'] = t IC„„'[n,6,t - t']. 
The possible form of the limit t ^ 0,S ^ can be written as 

lidn, S] - l)P(n, a, t) « £j,[x]p,(x, <), (17) 
^- J2 C:Ai^,S]P{n,<j',t) « ^ 0[x]p.,(x,t), (18) 



a' a^a' 



t-t>,-(x,t-i')- (19) 



Remark 4. The main reason to use Trotter approximation is that it was proven in 
[13], [S] and linj that if each operator £„ defined on X„ is an infinitesimal generator 
of a (strongly continuous contraction) semigroup T„(t), then the limit operator C 
is also the generator of (strongly continuous contraction) semigroup T{t) on X. 
This fact guarantees us that the continuum limit procedure produces a meaningful 
approximation of the real dynamics. For more details see pTj and [12] . 

3 General Fokker- Planck equation and the adia- 
batic condition 

Upon the condition that limits ([T]), ([8| and ^ exist, the probability density p{ii,t) 
satisfies a general Fokker-Planck equation of the form: 

^^^^-r[x]op(x,t)+£^[x]p(x,i). (20) 



If the limits (17 1, (18 1 and il9h exist, equation (20 1 can be modified into 



£*[x]op(x,<)+/CMx,i]*p(x,0, (21) 
where /C[x, i] * p(x,t) is a time convolution. 

Adiabatic condition 

The construction of the continuum limit involves a choice in which way (5„ and r„ 
tend to zero. This implies that the operators C and /C may have a pre-factor which 
is a function of 5„ and r„ . These coefficients determine the different time scales at 
which the operators C and /C influence the dynamics. We shall see in the examples 
that the continuum limit procedure often results in an FPE of the form 



11 



- L* [x] o p(x, <) + i £^[x] p(x, , (22) 

where e = e((5„, t„) G (0, 1]. This corresponds to the assumption that the Markov 
chain dynamics is faster than the diffusion process. 

The condition e = e(<5„,r„) small is called adiabatic, because it determines a 
separation between the dynamics of /C and of £. In fact for e = the dynamics of 
the system is dominated by the Markov chain at equilibrium. This is given by a 
linear combination of stationary measures of the Markov chain defined by 

Ai(x)/C[x] = 0. 

Intuitively one can see that for e small the time evolution of the whole system will 
organise itself around the steady state of the Markov chain. In order to introduce 
the result we need to define: 

Definition 5. Let C M^^ be the convex cone of stationary measures of /C[x]. 
Consider the operator 



(l^,£*Ai(x)(-)) = £a'aW\t^ai^)i-) whcrc = {(7 G E : Ai.(x) ^ 0}. (23) 

In |llj the following has been proved: 
Theorem 3.1. Upon the condition that 

= (1„ r /2(x)/(x, t)) + F{ic, t) (24) 

yields a probability density which is differentiable w.r.t. x and t G [0,To] C 
[0,T], for any smooth initial data and smooth F{x,t), equation (22 1 can be solved 
by an asymptotic expansion of the form 



p,(x,i)-^e"p(")(x,i). 



k=0 

Proof. Here we only present a sketch of the proof. This is essentially based on the 
adiabatic theory developed in [3]. In [11] we show that a solution of the ????? can 
be constructed asymptotically in e. The main steps of the proof are the following: 

1. Take /i(x) G and fix an initial p(x, 0) such that supp(/3(x, 0)) C supp(/i(x)). 

2. Consider an expansion of the form: /9c(x, t) = X]™=o ^" /"^"H^j 

3. Construct the equation at each order n. 

4. Decompose each p'")(x,t) using the projection 11^:: 

p(")(x,i)=e^")(x,t) + M(n)/(")(x,t), 

where 
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5. Construct the hierarchy of equations: for n = 0: 



^^^^ = (l,^,£*[x](^(x)/(")(x,t))) 



(25) 



and for n > 1 we have 

^»(x,<) = (£T)% 
9/(")(x,<) 



5^>-i)(x,t) 



£*(e>-iHx,i)+A?(x)/("-iHn,t)) 



9i 



(V,r(M(x)/(")(x,t))) + (l,,,£*(C»(x,t))), 



(26) 



where (ICj^)^ is the Drazin inverse of /C. 



6. The evaluation of the remainder of the asymptotic series is then carried out 
as in PT| . 

□ 

If the adiabatic condition holds then the asymptotic approximation can also be 
constructed for a ME of the form 



= r [n] o Pin,t) + i/C^[n]P(n,t). 
ot e 



(27) 



In this case the hierarchy of equations has to be modified accordingly. For the 
benefit of the reader we include the the hierarchy of equations. 
For n — 0: 



5/(0) (n,i) 



dt 



(l^,/:*[n](/i(n)/(")(n,i))) 



(28) 



and for n > 1 we have 



e(")(n,i)^(/C^[n]^)% 
a/(")(n,i) 



dt 



r[n](e("-i)(n,t)+Mri)/("-^)(n,i)) 



dt 



1^,£* [n] (/x(n) /(") (n, t))) + {1,, £[n]*{e"^ (n, t))). 



(29) 



13 



3.1 Reduction of the Interaction Graph 



Equations (20 1, (21 1 allow again an interpretation in terms of graphs. In fact the 



operators C and K?^ describe the rates at which the transitions of type 

(x,a)^(x',a') 

occur. We can define: 



Definition 6 (Interaction Graph for the FPE). We termXG(y, E) the graph whose 
vertex set is ^ = x S and edge set is E{L^ K.) where the directed link e(5j g.) (^j/ g.') 
is present if £ and JC allow the transition (x', a') t-^ (x', cr'). 



Remark 5. One can think that a representation of this graph can be obtained by 
looking at the Figures [l] and and|2] where instead of n's there are x's. This is only 
partly true because it might happen that the continuum limit procedure removes 
some states and is thus changing the graph topology. 

We can observe different levels of reduction and simplification of the Interaction 
Graph Tq- If C* is such that 

(i) ^ for a^a', 

(ii) >C*g. are Fokker-Panck operators, 

then the only possible processes have the form: 

(a) (x,ct) (x',cr), 

(b) (x,a)^(x,a'). 

In particular (a) corresponds to a diffusive Markov process and (b) corresponds 
to a finite Markov chain. We can think to the following scheme: on each point of M.^ 
where the diffusion take place there is a "fibered" Markov chain whose transition 
rates are functions of x, see Figure [Sj 



Markov chain 



difi'usion 



Figure 3: A Markov chain "fibered" over M^. 



This reduction takes place also in equation (27 1 
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3.1.1 The average dynamics and its Interaction Graph 

Let us now consider the zero order approximation of the e expansion. This is given 

by 

^^'gf'^^ - (l;r,£*[x](/I(x)/W(x,i))). (30) 

This is called average dynamics. The average dynamics is a Liouville equation 
for a deterministic vector field given by 



dx(t)) 



dt 

We can give a description of the average vector field by using the notion of an 
interaction graph. We define: 

Definition 7 (Interaction Graph for deterministic dynamics). For a given vector 
field X{x), the Interaction Graph = Ic{X) is the couple {V,E.^) where: 

(i) V is the set equal to the collection {xi, x^}, 

(ii) E-^ is the set of edges e,y . The edge eij is associated to the couple of vertices 
(xj, Xj) if 

g^.(x) . ^ . , ^. 

— IS not identically zero. 

dxj 

(iii) The edge eij is directed from j to i. 

Note that for each fixed ct G S we can associate a vector field 

A-(-)(x(t)) = - J2 ^I'Am], (32) 

and therefore an interaction graph Xq{X^'^^). A graphical description is presented 
in Figure |4] 

It is simple to note that the average vector- field (31 1 can also be written as 
dx(t)) 



dt 



= <f;r(x) = -^A'('^)(x)A.,(x). (33) 



This vector field is the average of all taken against the invariant measure 
/i(x). This implies that the associated interaction graph 2'g(A'^) has a new structure. 
The vertices V = {xi, xn} will not contain reference to the specific Markov chain 
state (7 and new edges will appear as a result of new interaction terms resulting from 
the averaging procedure. 

Remark 6. It is worth noting that if {A'*^'^^}o-es are all polynomial vector fields 
with integer coefiicients, then the average vector field can be rewritten as 

^ Ni7(ii). (34) 
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Figure 4: The Interaction Graph for a fixed state ct e in the Markov chain 




Figure 5: An example where = {cri, 0-2} and x = {xi,X2, ^3, 0:4). The averaging 
process gives rise to an new Interaction Graph depending on the combination of 
1q and 1q . The edges that are present in Xq (dashed arrow lines) are eventually 
also present in Iq, and so do the edges (point arrow lines) present in Iq^. Note 
that there might occur compensations that delete some links. 
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Here i7(x) is a vector field whose entries are in general rational functions. At 
this point the analysis could proceed along the lines of exploiting all the graphic 



structure present in ( 34 1 . A review of the results in this direction is presented in 
i- 

In the next section we shall look at some simple examples. We restrict ourselves 
to the case of models where all the waiting times are exponentially distributed. 
Therefore we consider an infinite Markov coupled to a finite one and we show that 
also in this simple setting many interesting properties and question arise. 

4 Examples 

Let us first fix our setting. To avoid cumbersome notation we drop the index from 
6n and t„ and the projection Vn- We shall consider the following cases 

(i) L = (5 Z a random walk with an internal two-state space S (switch). 

(ii) L = (5 N a single particle regulating a two-state switch. 

(iii) L = X (5N two particles A and M. A regulates a two-state switch which 
in turn regulates M. 

The finite set E is always a collection of states modelling "molecular" operators 
and for this reason the elements of E will be denoted by O^, with a — 1, M. The 
processes will be given in terms of reactions that will be interpreted as reaction 
rates. In the examples we formulate the problem using the reactions to construct a 
Master equation of the following form 



dPa{n,t) 1 



dt 



(35) 



where C^a' [n, 5] is function of E,^. . In the various examples we want to illustrate 
how to define the continuum limit. For equation (35) the limit can be obtained by 



(36) 



defining (14 1, ( |15[ ) and ([16|. In particular we shall consider cases where 
- !<^<ya'[n,S]P{n,a,t) ~ - ^i^<TMp<T'(x, i), 



with e = e(i5, t) for (5, r — > 0. Upon this condition we shall show that a master 
equation has limit of the form ( 22 1 . 



4.1 Effective diffusion 

In the first example we consider a particle performing a random walk on L = (5 Z 
with rates depending on an internal state G E = {Oq, Oi}. The internal state 
dynamics is a Markov chain whose rates are dependent on the point where the 
particle is at time t. We assume exponentially distributed waiting times. The aim 
is to show the various scaling regimes when i5, r — > 0. In the adiabatic regime the 
motion of the particle will be given by an effective diffusion equation. The processes 
can be described through the following reactions 
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Diffusion with random rates 

v'' (S.r) 

N , ' iV + 1 for i = 0, 1 

IL^ (S,t) 

k'''(N,S,T) 

The state a time t is determined by the probabihty distribution 

P{n,t)^{P„{n,t),Pi{n,t)). 
The Master equation is given by: 



particle motion 



dPoin,t) 



dt 



= {uo{S, t)/t) {Po{n - 1) - Po(n, t)) + («o('5, T)/r)(Po(n +l,t)- Po{n, t)) + 
Markov chain: rates dynamics 



-{k\n, S, T)/T)Poin, t) + {k\n, S, T)/T)P,{n, t) 

particle motion 



dPiin,t) 
dt 



= {u,{S,t)/t) (Pi(n- 1) -Pi(n,i)) + («i(<5,T)/r)(Pi(n + l,t) -Pi(n,i)) + 



Markov chain: rates dynamics 
I +{k'{n, 5, T)/r)Po{n, t)~ {k%n, 6, r)/T)Pi{n, tj 

This can be rewritten as 



(37) 



f dPoin,t) 
dt 



= {uo{S, r)/r) A- (Po(n, t)) + {vo{5, T)/r) A+(Po(n, t))- 



-ik\n, S, T)/T)Po{n, t) + {k°{n, 6, T)/T)Pi{n, t) 
dPi{n,t) 



dt 



- {u,{d, t)/t)A- {Pi{n, t)) + (t;i(<5, T)/r) A+(Pi(n, t))+ 



[ +ik\n,S,T)/r)Po{n,t) - {k°{n,5,T) /T)Pi{n,t) 



By applying ([TT| Pi{n,t) V{pi{x,t)), for 5,t ^ 0., we get 

{k\n, S, t)/t)P(po(x, t)) = V{{k\x, S, t)/t) t)), 
{k^{n, 6, T)/r)V{p,{x, t)) = V{{k^{x, 6, t)/t) po{x, t)) 

and 



(38) 



{u,iS,T)/T)A-V{p^{x,t)) « (u,(<5,r)/T)P 
iv.{6,r)/T)A+V{p.{x,t)) « M6,r)/T)V 



.3 Pi b^d^p, 



dx 2 dx'^ 

■ dfh ^ 
dx 2 dx'^ 
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We now chose the scahng for ^ ^ 0, r ^ 0: 



MS, t)/t) ~ uje, {v,{S, t)/t) ~ v,/e, (fc"(,x, S, t)/{St)) ~ fcO(.T)/e, {k\x, 6, t)/t) ~ k\x)/e 

for i = 0, 1 and some e = e((5, t). Then we can take the continuum Umit and 
obtain: 

dpo{x, t) _ 6 (do - uo) dpo{n, t) ^ 6^ {vq + uq) d^po{n, t) _^ 
dt € dx € dx"^ 



-^PoKt) + ^Pi(x,t) + -o(<52) 
e e r 

dpi{x,t) _ d{vi- Ml) dpo{n,t) _^ {vi + m) d^pi{n,t) ^ 



(39) 



at 

A:i(a;) 



9a; 



Po(ri,i) - ^-^pi(x,t) + -o((52). 
e e T 



It is useful to check the compatibility. First note that to simplify o{S'^) /r term 
we need that r — > such that 

- o{6^) ^ 0. 

T 

Next we explore some further consequences of the choice of e. 
(i) If e ~ eo > then the system reduce to a simple Markov chain. 



(ii) If e ~ 5 then, as (5, r ^ the system reduces to a drift plus a " fast" Markov 
chain. In fact 



{Vo - Wo)5x(-) 









(ii) If e ~ and 



{Vi{6,T) -Ui{S,T))6 



and /C^ 



1 / -k°{x) k^{x) 
e I A;°(a;) -k^{x) 



V, for i = 0, 1 



for some Vi as 5, t ^ 0, then the system reduces to an effective diffusion plus 
a "fast" Markov chain. In fact C* and /C^ read 



C* 



and /C = - 



1 / -k^{x) k^{x) 



In the adiabatic regime the average dynamics appears to be an effective diffusion. 
In fact the invariant measure of the Markov chain is 



k\x) 



k°{x) 



k^{x) + k^{x)' k^{x) + kO{x) J ' 
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Equation ( 30 1 then becomes 



dt dx 



Vik^{x) 



fci(a;) + fcO(a;) k^{x) + k°{x) 



/(0)(x,t) 



dx^ 



(uq + vo)k^{x) {u 
k^{x) + k^{x) k 



^{x) + k'^yx) J 



(40) 



Remark 7. Before introducing the switch reactions we make a comment about the 
continuum hmit in the case in which a term 



/■* 1 

/ dt' -JC„„\n,5,t-t']P{ii,a\t') 
Jo T 



is present. One can observe that in this case the continuum hmit depends on 
how the time scale r is related with the scale at which the waiting time is defined. 
Possibly there might be regimes where if r is small enough. Then 



' dt'-K„„,[n,6,t~t']P{n,a',t')K f dt'-£,,, [x, i - (x, t'), 

where /Co-o-^x, i — t'] a new operator. The main problem is to identify some 
general minimal properties for such classes of scaling. 

4.2 Switch reactions 

We now consider a set of reactions that form an elementary " switch" . This is 
essentially a system formed by two types of particles (two chemical species) A and 
M interacting with a two-state system S = {Oq,Oi}. Particle A regulates the 
switching and the two-state system which in turn regulates M. First we consider a 
single switch. Its defining reactions are: 

A + Oo^=^0i. 

We show that if the dynamics of A is included in the Master equation (ME) , the 
continuum limit and the adiabatic theory (the time scale of the process involving 
the finite states {Oq, Oi}) imply that the noise is not Gaussian at order 0(e). This 
is related to the fact the the operator C* in the ME is not diagonal, because there 
are reactions involving transition in L and E. Let us consider the following two 
systems of reactions: 

System n.l System n.2 

A + Oo^=^0i, A + Oo^=^Ou 

k<>{S,T) kO{S,T} 

Oi O0 + M + A, Oi -^'^(*.^) Oi + M, 

The dynamics of the two reaction systems can be expanded asymptotically in e. 
It turns out that the systems have the same deterministic limit but with different 
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noise terms. Namely the dynamics n.l and n.2 have same 0(1) (average dynamics) 
but differ from order 0(e). We further analyse this point in System n.l by including 
the A dynamics. 



4.3 A more detailed analysis of a switch reaction 

Consider the reactions 

A + Oo^=^0i. (41) 

k»(S,T) 

We are interested in describing the reactions without assuming that A particles are 
constant. We assume that there is a pool of A from which particles are "created" 
and " annihilated" . The annihilation from the pool corresponds to the absorption 
of an A particle by Oq and the transition to Oi . The creation corresponds to the 
releasing of an A particle from Oi and the transition to Oq- In order to simplify the 
notation it is useful to introduce the following operators. The state is identified by 

P{a,t) = {Po{a,t),Pi{a,t)). 



Using reaction (41) its ME reads 

^^^^ = -{k\6,T)/T)aPo{a,t) + {k''{6,T)/r)P,{a - l,t) 

(42) 

BP (n f\ 

^ = {k\5, t)/t) {a + 1) Po(a + 1, t) - (fcO(5, r)/T)P,{a, t) 
Now using the definition of A J the ME can be rewritten as follows 

Markov chain one a is released 



dPo{a,t) 



{k\6, t)/t) a Po{a, t) + {k\5, T)/T)P,{a, t) + A-((fci(<5, r)/r) Fi(a, t)) 
Markov chain one a is absorbed 



= {k\5, t)/t) a Poia, t) - (fc"(<5, r)/5)Pi(a, t) + A+((fc°(<5, t)/t) a P,{a, t)). 

(43) 



The ME can be recast as in ( 27 1 by defining 

r., , , ( A-((fci(5,r)/r)(.)) 

\At{{k\5,T)/r)a{-)) 

and 

' -ak^{S,T)/T k^{S,T)/T \ 



)C^[a, 6, t] 



ak°{6,T)/T -k^{S,T)/T 



Remark 8. C* is non-diagonal and depends on the Markov chain parameters. For 
the adiabatic limit the continuum limit is needed. The operators A~((A:^((5, t) /t)(-)) 
and A+((fc"((5, r)/r) a (•)) can have a finite limit as 5, r ^ 0. 
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4.4 Continuum limit 

Let us assume that for 5, r ^ we take 

St e ' r e 

for some e = e((5, r) and A;*', /e^ > 0. Then the difference operators will have the 
following asymptotic exapnsions: 

A-((^^(^,r)/r)(.))«- — ^ + — 

and 

Taking r, J — > such that 

- o{6^) ^ 0, 

T 

the limit of the ME reads 

dp ^* , 1 

The form of the operators £ and AC is identified by the following two cases: 
(i) if e{6, r) ~ eo as 5, r — > then 

xk° -k" 1 ' 



£ = and K.^ 



(ii) if e((5, r) ~ ^ as ^, T — > then 

= ^ ^ and x:^ = 

\ a:,(fcOx(-)) J \ Xk° -k^ J 

We like to consider the case (ii). In this condition we can apply adiabatic theory. 
First note that K.^ invariant measure is 



k X 



^k^x + k^' k'^x + k\ 
The adiabatic limit can be computed. In particular at order 0(1) we found 

Using the explicit form of the invariant measure it is easy to verify that 

(-fc^/Ui + k^xjio) 

identically vanish, which means that the concentration x = [A\ is constant along 
the average dynamics. 
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4.4.1 Noise at order 0(e) 

As shown in at order 0(e) the noise can be evaluated by computing 
(l,£*(e(i))) = -(l,£*(/C^)^r(/./W)). 

Now 



(fc"x + fci)2V k^x J \ d.Ak° X iio f^°^) 

which is equal to 

^ ' ^~ {k^a + k^Y\-k°x^.,{k^^JiU)~k^^^{k^x^iof°'^) ) 

Using /xq + /ii = 1 the expression 

fc° X 9, (fe Vi /^"^ ) + fc' 5. a; /io /(°) ) 
can be rewritten as 

so 

Finally the noise term can be computed. It is equal to 



^ ' ^'■^ " dx \{k° x + k^)-^ dx {k^x + k^Y^ 



(fc" xfk^ a/W ^ (fc")2a:fcVo ^(0) 



(fc"x + fci)2 ax (fcOx + fci)- 

It is not difficult to show that the noise term determines an elliptic operator which 
is negative definite. We can therefore conclude that the noise at order 0(e) does 
not determine a genuine Fokker-Planck equation and therefore the time evolution 
of the concentration x cannot be described - on short time scales (see [5], [5], [7j) - 
through an Ito stochastic differential equation. 

4.5 Analisys of systems n.l and n.2 

Let us consider reactions in system n.l: 

Oo + M + A, 
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The state of the system is defined by the probabihties 

P(m,a,t) = {PQ{m, a,t), Pi(m, a,t)). 

Remark 9. Without loss of generality we can assume that the number of A particles 
a is considered large: a ± 1 ~ a. 

The ME reads 



Markov chain 

dPo{m, a, t) ^ ^^1^^^ r)/T)Po(m, a, t) + {k\5, T)/T)P,{m, a, tj + 
degradation 



-{■y{S, t)/t) m Po{m, a, t) + {'y{S, t)/t (to + 1) PQ{m + 1, a, <) + 

creation of a to and transition to Oq 
+ {v{5,T)lT)Pt{m-l,a,t) 

Markov Chain 

' ' = a{k\6,T)/T)PQ{m,a,t) - {k\5,T)/T)Pi{m,a,t)+ 



dt 

degradation 



(44) 



-(7((5, T)/T)mPi{m,a,t) + (7((5,t)/t) (to + 1) Pi(m + 1, a, + 

creation of a to and transition to Oq 
-{:y{6, T)/T)Pi{m,a,t) 

In matrix form the ME reads 

dP(m,a,t) , ,^rp ^, 

^ ' ' ' = C* Pirn, a, t) + IC^ P(m, a, t , 

ot 

where P(m,a,t) = (Po^m, a,t), Pi(m, a,t)) and the operator C* is 

1 / 7('5,r)A+(m(-)) HS,r)E- \ 

r[ 7(5,r)A+(m(.))-K^,T)id yl ■ 

Remark 10. Note that the matrix of the operator C* is not diagonal, but the 
theory developed in [TTl still applies. 

The Markov chain has transpose generator given by 

-ak°{S,T) k^S,T) \ 
ak°{6,T) -k\S,T) J ■ 



T 1 
T 



Its invariant measure is 



k^{S,T) fc°((5,T)fl 

fcO((5, r)a+fci((5, t) ' fc"((5, r) a + fci((5, r) 
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Assumption 1 (Adiabatic assumption). We now assume that without performing 
the scaling 6 and r — > the time on which the Markov chain on E reaches 
its equilibrium measure is faster than the time evolution of m,a. Therefore we can 
make the following formal substitution 

e 

At this state we can construct the solution by the asymptotic expansion in e 
according to the scheme developed in pT| . 

Average dynamics 

The leading order term of the expansion is given by 



(l^,r(/i(n)/(°)(n,t))), 



dt 

This is the average dynamics. In the present example note that 1^ = 1 = (1, 1) 
for there is a unique invariant measure. Using the expression of C* . An explicit 
calculations yield 

(l^,r(/.(n)/(")(n,t))) = 

= (7(<5, r)/r) A+ (/.o m f'^^'Hm, a, t)) + {j{S, T)/r) A+ (^^i m /(")(m, a, t))+ 
+{,^{6, t)/t) E-ifi, f^'\m, a, t)) ~ {v{5, t)/t) mi f^^'Xm, a, t). 
Now use + Hi — 1 and the explicit expression of /xi to obtain 

(l^,£*(Mn)/(°Hn,i))) = (7(^,T)/r)A+(m/(0)(m,a,t))+ 



+(K5,r)/T)A; 

Therefore the average dynamics is given by the following Master equation 



dt 



+(K5,r)/T)A; 



f(0)(^ a t)] 



(45) 



kO{6, 

An important observation is the following: 

Remark 11. Note that by taking a reaction (like in system n.2) 

Oi -,''('5^^) Oi + M (46) 

instead of 

Oi ^'^('5'^) Oo + M + A, (47) 



we would obtain the an average dynamics equal to equation ( 45 1 
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From the previous remark one can show that the continuum hmit of the average 



dynamics for a system containing reaction ( 46 1 coincides with the one containing 



reaction (47 1. Let us observe that the difference in the two systems of reactions 



appear only in the operator £*. For systems with reaction (46 1 the operator £* 



is a diagonal matrix with entries difference operators. For a system with reaction 



(47) the operator C* is a no longer a diagonal matrix. In order to see the differ- 



ence between the two systems it is necessary to look at higher order terms in the 
expansion. The generic order 0(e) corrections are 



eW(n,t) = -(/Cj)^/:*(Mn)/(°)(n,t)) 

^-f^}^ ^ (l^,/:*(M(n)/W(n,i))) + {l,,C*{e^\n,t))). 
Consider the two systems of reactions 
System n.l 
A + Oa ^''"'^^'^^ Oi, 
Oi ^'^'(■5.^) Oo + A, 

-,''{6,r) Oa + M + A, 
M ^fi^^-^) 0. 

These systems differ only in the form of the operator C* . For system n.l 
and for system n.2 



System n.2 
A + Oo ^''"'^^'^^ Oi, 
Oi -^>''i^:^) Oo + A, 
Oi ->''(*>^) Oi + M, 



(48) 



r* — 
'-2 — 



1 / 7('5,r)A+(m(.)) 
t\ 







7(5, r) A+(™(.))-K'^,r)A,-((.)) 



The two systems have the same Markov chain therefore same invariant measure, 
and the same Drazin inverse (ICj^)^ ■ We have already pointed out that the average 
dynamics is t he s ame for both systems, but now let us look at the first order 
corrections in (48 1. Both systems have the same solution /("'(n, t) to the average 
equation. It is sufficient to consider the equation for ^'^^^(n, t). In fact for system 
n.l 



and for system n.2 



T\D r*i 



P(0)/ 



Now take the difference of the equations to obtain 



el^^(n,t)-e^^^(n,i) = -(/CD^ri(/i(n)/(°)(n,t)) + (/CD+/:;(M(n)/(°nn,i)). 



26 



We then use the hnearity of the operators to write 



£2 - ^ 



Now using the explicit expression of C* operators, one finds: 

1/0 -^.(<5,r)E„((.)) \ 
-K<5,r)(A- -id)((.)) ; ■ 

The difference is not identically zero, therefore we can conclude that system 

n.l and n.2 have adiabatic limits which generate two stochastic processes which differ 
at order 0(e). 

Now suppose that we take the continuum limit. Clearly it can be shown (from 
that up to order 0(e) the dynamics is described by a stochastic differential equation 
(SDE), whenever C* is diagonal. The noise term is essentially related to the formula 
for ^(^)(n,t), which contains at order 0(e) the differences between system n.l and 
n.2. 

4.5.1 Explicit construction of the noise 

We now compute the noise term (up to order 0(e)) for the systems n.l and n.2. 
First recall that in both cases 



T\D 



{ak"{S,T) + k^S,T))^ 1 afcO(J,r) -k\S,T) 



System n.l 

The noise is 

(i,/:t(eW)) = -(i,/:* (/c^)^ri(/./(°))). 

After some lengthy but simple calculations one finds 

-{i,ci {^^rcl{^,n^ 

= (qfco~_^fci)2 [(-^Vi'^7 + afcVoi^7)A-(A+(m/(°))) 
+afcVi^'A,- (E„(/W) + fcVi^'A„(/W) 

It is not hard to see that the noise term gives rise to a parabolic operator which is 
not always positive definite. 

System n.2 

For system n.2 performing the same calculations one finds 

-{l,CUK^rCl{^,n = ^^A+(mA+(™/W)) + 
ak'^k^v-iT r^-,^ + ,_f(o).. , , -..(0)... , ak^'k^v'^T 



— fA"(A+(mf^"M) + A+(mA"(f^"^))l + (A~ (A~ ( f^''^))) 

(afc'' + fci)3 "^^ "^^^ (afc*' + fc~)3 

Remark 12. For system n.2 it is crucial that £2 diagonal. 
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5 Detailed analysis of system n.l 

In this section system n.l is analysed assuming that also A molecules have a dy- 
namics. Now the ME reads 

' - ~{k\6, t)/t) a Poim, a, t) + (fc"(<5, T)/T)Pi(m, a -I, t)+ 

+{v{5, t)/t) Pi(m - 1, a - 1, i) + A+ ((7(,5, t)/t) m Fo(m, a, t)) 

= T)/r) (a + 1) Po(m, a + 1, - (fc"((5, r)/T)Pi(m, a, i)+ 

t)/t) Pi{m, a) + D+{h{S, t)/t) m Pi{m, a, t)). 

(49) 

The ME is not in the form of an operator plus a Markov chain. To rewrite it in 
that form one can use the operators and E^: 

^^"^y;"'^^ = -{k\S, t)/t) a Po{m, a, t) + [{k'{S, t)/t) + {v{6, T)/T)]P,{m, a, t)+ 
+A-{[{,y{S, t)/t) + {k\S, t)/t)] Pi{a, m, t)) + A+ ((7((5, t)t) m Po(m, a, t))+ 
+A-,((z.(<5,r)/T)E-(Pi(™,a,t))) 

^^'^g/"'^^ = (fci(<5,r)/T)aPo(m,a,i) - [(A;"(<5, T)/r) + ^5, T)/<5)]Pi(a, i)+ 

^ +A+((fcO(<5, r)/T)Po(™, a, t)) + A,- ((7(5, t)/t) m P,{m, a, t)) 

(50) 

Now the form (p7|) is obtained by taking 



T 1 
/C^ = - 

T 



^afc"(J,r) /c1(5,t) + i^((5,r) 
ak°{d,T) -k^{6,T)^i^{S,T) 



and 

^ 1 / A+(7(<5, T)m(.)) A- {[i.{S,T) + k\S,T)]{-)) + A;^{Hd,T)E- {{■))) \ 
" r [ A+(afcO(<5,r)(.)) A+ (7(<5, r) m (•) ) j 

5.1 Continuum limit 

Looking at the terms in the operators /C"^ and C* it is possible to guess a limit 
behaviour. We chose a scaling as follows 

k°{S,T) ^k° 6k^{6,T)^k^ v{d,T) 7((5,r)_7 
St e ' T e ' t e' 6 t e 

Then proceeding as in the examples above we take e ~ 5 as 5, e ^ and we obtain 

1 / -afcO k^ + v \ 
e \ ak° -k^ -V 
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and 



Then the limit ME have the form 

dp{m,a,t) ^ , 1 irT' ^ +^ (r.^\ 
— = £ (p(m, a, i)) + -/C p[m,a,t) (51) 

Remark 13. Note that also in this case there is no diffusion term in C* . 



Upon the validity of (51 1 the theory in [TTj applies and an average dynamics can 
be computed. The new invariant measure is 

k'^ + v k^a 

The ME at order 0(e°) is 



k° a + k'^ + k° a + k^ + V 



dt 

which turns out to be 



This corresponds to an average dynamics being equal to: 

vk'^ a(t) 

m(t) = -7m(t)+^.o„(i) + fci + ,' 
a(t) = 0. 



As in the switch reaction (section [4. 3 1 the average dynamics of a is trivial. Let a(0) 
the initial value of A molecules. Then the steady state value for M molecules is 

_ iyk°a{0) 



7 (fco a(0) + k^ + iy)' 



6 Conclusions 

This paper shows a possible way to model reactions networks containing possibly 
more than standard mass-action kinetics. We used finite states which can model 
conformational changes of larger molecules, like proteins and corresponding bind- 
ing/unbinding events of smaller molecules, typically substrates binding to the pro- 
tein. The finite number of such larger proteins can be included in the structure of 
the finite state Markov chain, as it has been illustrated in [TT] and [T5]. The ap- 
proach is based on the analysis of the different scales (spatio-temporal and number 
of particles) present in the system. The multiscale analysis leads naturally to the 
idea to compare the dynamics of the discrete states with the dynamics governed 
by mass-action kinetics. This comparison is done through adiabatic theory. The 



29 



theory has many appHcations, primarily in cell biology to describe both the spatial 
and spatially averaged dynamics of macro-molecular interaction with substrates, 
ions or transcription factors. Obviously it can also be used in completely different 
branches of science where a similar setting can be defined in a meaningful way. 
Some simple examples show this large potential of the approach. In future work 
the theory will be extended to systems whose underline stochastic dynamics is not 
Markovian. This is especially relevant for different cellular transport processes. As 
we could derive macroscopic equations from microscopic interactions, for example 
also capturing all classical enzyme kinetics, the next task in the analysis is to find 
ways of analysis how large systems of macroscopic reaction kinetics behave qual- 
itatively, given their interaction is described by a graph containing the essential 
information of these interactions. Such approaches are reviewed in [3]. 
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